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ABSTRACT 

» The application of artificial intelligence (AI) 
techniques to the design of personal learning environments is an 
enterprise of both theoretical and practical interest. In the short 
tera, the process of developing and testing intelligent tutoring 
programs serves as a nev experimental vehicle for exploring 
alternative cognitive and pedagogical theories. In the long term, 
such programs should supplement the educational supervision and 
guidance provided by human teachers. Th~s paper illustrates the long 
term perspective by a scenario vith Sherlock, a hypothetical LOGO 
tutoring system for elementary graphics programming which was in a 
preliminary design stage at the time this paper was written. 
Twenty-three references are listed. (Author/LLS) 
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The application of artificial intelligence (AI) techniques to the design of 
personal learning environments is an enterprise of both theoretical and practical interest. 
In the short term, the process of developing and testing Intelligent tutoring programs 
serves as a new experimental vehicle for exploring alternative cognitive and pedagogical 
theories. In the long term, such programs ihould supplement the educational supervision 
and guidarce provided by human teachers. This paper illustrates our long term 
perspective by a scenario with a hypothetical tutoring system for elementary graphics 
programming. 
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1. Introduction 

..If [the science of education] intends to limit itself, in conformity with the positivist 
conception of science, to a simple investigation into facts a*d laws, without claiming to 
explain what it states, then naturally there is no need whatever for a connection with 
psychology. .. But if experimental pedagogy wishes to understand what it is doing and to 
complete its observations with causal interpretations or "explanations", it is obvious that it 
will have to employ a precise psychology... 

[Piaget 1972] 

The design of AI based tutoring programs represents a new paradigm for educational 
research. This paradigm involves a unique marriage of methods and goals from artificial 
intelligence, psychology, traditional pedagogy, and computer science. 

1. The Al goal is to sxplore powerful computational (AI) theories of learning 
and problem solving. The method is to design, implement and test programs that 
embody these theories. 

2. The psychological goal is to account for the knowledge states and learning 
strategies of individual students. The method is to analyze protocols of students 
interacting v. ith precisely controlled tutoring environments. 

3. The pedagogical goal is to experiment rigorously with different tutorial 
strategies. The method is to systematically vary the pedagogical strategies employed by 
the tutor. 

4. The computer science goal is to articulate the design principles for programs 
of this nature and level of complexity The method is to construct antf debug such 
systems. 

This paper introduces the direction of our research by means of a scenario involving 
Sherlock, an imaginary computer tutor 1 {F.gure I) provides a tentative block diagram for Sherlock. 
Understand. ng the theory and technology that will make such computer tutors possible Is our 
ultimate goal, developing the individual components constitutes our current research focus. Since 

o 
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An Intellitent Tutoring System 



(Idealized Block Diagram) 
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| Projects | 




(Figure !} 
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each component is a significant undertaking in its own right, capabilities at the level this scenario 
proposes are not imminent. But if the highly restrictive teaching programs provided by traditional 
computer aided instruction (CAI) are to be superseded, then the design of learning environments 
which incorporate computational models of both the student and the teacher is essential 

This paper is not a technical exposition: its sole purpose is to convey our sense of the 
direction in which CAI ought to be headed. It does not address the objection that tutors such as 
Sherlock may be too far beyond the state of the art to be a profitable research focus. Evidence that 
research into the design of AI based learning environments provides a powerful medium for 
exploring computational theories of cognition and pedagogy is described elsewhere. (See, for 
example, [Brown et at. 1974], [Collins et al. 1975], [Burton Sc Brown 1976], [Goldstein k Miller I976bl 
fMHIer & Goldstein I976a.b,c,dl) 



« 



Al Based Learning Environments 6 Goldstein U Miller 



2. Scenario With a Hypothetical Lego Tutor 

leave the students as much freedom and initiative as possible under existing teaching 
conditions. Pressed for time, the mathematics teacher is often tempted to sin against ... 
{ ~ the principle of active learning. He may hurry to the solution of a problem without 

leaving enough time for the students to put the problem to themselves in earnest. He 
may name a concept or formulate a rule too soon, without sufficient preparation by 
appropriate material, before the students can feel the need for such a concept or rule. He 
may commit the celebrated mistake of deus ex machina: he may introduce some device 
(for instance, a tricky auxiliary line in a geometric proof) which leads to the result all 
right, but the students cannot see for their life how it was humanly possible to discover 
such a trick which appeared right outtof the blue. 

[Polya 1965] 

This section illustrates, in the form of a hypothetical scenario, the nature of Sherlock, an 
intelligent tutor which we are designing and plan to implement. The tutor would operate in the 
domain of Logo turtle geometry. The turtle is a graphics cursor capable of drawing on a computer 
display The turtle has a state, which consists of its location, its heading, and whether its pen is up 
or down Primitives in the Logo programming language (FORWARD, RICHT, PENUP, PENDOWN) 
alter these attributes of the state vector independently. The task of the student is to define 
procedures that draw his or her intended pictures. 

We have chosen this domain foi o ir initial example for the same reason that it is used 
by the Logo Project it is an excellent environment for revealing problem solving methods [Papert 
I97la,b, 1973} Both the general medium of programming and the particularly concrete nature of 
graphics tasks encourage this Furthermore, there has been a great deal of work with students in 
this domain Many case studies of individual students are available (e.g., G Goldstein [1972], 
Okumura [1972], Solomon [1976b]), and several styles of teaching have been investigated (e.g., 
Austin [1976], Hildreth [1975], Solomon [1976a]). However, though introductory Logo programming 
will be our initial domain for designing a tutor, we believe that many attributes of the Sherlock 
tutor, including its general problem solving knowledge, the methods governing the construction of a 
student mode!, and the various pedagogical techniques directing the tutorial process, will be 
applicable to the design of tutors for other areas of study. 

8 
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The tutor's practical goal is to guide the student through introductory Logo programming 
projects. Conceptually, its objectives are to advise the student concerning the use of various 
problem solving techniques. These include: 

1. alternative planning methods such as sequential planning, in which a 
problem is divided into separate pieces which are solved independently; and recursive 
planning, in which a problem is reduced to a simpler version of itself until a directly 
solvable case is reached; { , 

2. debugging knowledge for diagnosing the underlying cause of a bug. 
understanding the typical failings to which various plan types are susceptible, and 
handling complex situations involving multiple bugs; 

3. anticipatory strategies for ensuring program extensibility and ease of 
debugging, such as adequate documentation and modular design, 

4. the importance of carefully describing the problem, the solution plan, the 
finished program and the relations between them. 

The scenario raises many complex questions of tutorial strategy, such as how frequently to 
interrupt the student with advice, and under what circumstances to allow the student to proceed 
even though a blind alley is being pursued. Furthermore, the scenario presumes powerful facilities 
which are peripheral to this essay: for example, a sketch recognizer for tablet input, and a 
sophisticated natural language front end. The reader is asked to postpone concern with these 
important problems. Since it would be impossible to address so many Issues in a single paper, we 
concentrate, instead, on a single aspect: the fashion in which an understanding of planning and 
debugging guides the tutor's interactions with the student. 

2d. Defining 

Hello. 

Welcome io Shtrhck, in* tutorial Ugo monitor! What it your nomo? 
Debbie Smith. 
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Hello, Debbie. Coed to tee you again! 

Here it has been assumed that the student has used the learning environment previously. 
Consequently, Sherlock Is able to read in files containing the programs which she has written, the 
history of previous sessions, and a detailed model of her current knowledge and skills. 

/ have been intruded to provide maximum tutoring} I will make mggeitiom whenever I 
think that they might be helpful. Feel free to oik queuiont at any time. Alio, if you tell 
me a little about what you are trying to do, I eon be more helpful. 

t 6 

A practical system would require flexible natural, language input whfch allowed the 
student to ask questions at any time. A simple parser with a small grammar, however, might be 
adequate for a workable prototype. 

• * 

I am going to draw a napoleon. 

I don't think I have over Been a napoleon. PerhapM you could dram one on the tablet, ju$i to 
give me the idea. 

Ok. 

Ideally, She.lock would have a module for analyzing simple sketches drawn on a tablet. 
This would obviate the need for the student to describe the intended picture in a formal model 
language. Instead, the system would have a large database of knowledge about the pictures 
commonly encountered in beginning projects represented as predicate models. It would be the 
tutor's responsibility to match a model to the sketch. 3 See {Figure 2} for an example of such a 
picture model for a stick figure and {Figure 3} for the student's tablet input. 

V ^ 

0h t I $ee t napoleon i$ a nick man, only with a funny headt 

The sketch understander would identify this particular sketch as an instance of the STICKMAN 
model, except that the HEAD is unusual. 



That'i hit hat! 
Oh! Ok. 



to 
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p,*Air*t» Model* For A Sticktnan 



MODEL MAN 

Ml PARTS HEAD BODY ARMS LEGS 
M2 EQUITR1 HEAD 
M3 LINE BODY 

MS CONNECTED HEAD BODY, CONNECTED BODY. ARMS, CONNECTED BODY LEGS* 
M6 BELOW LEGS ARMS, BELOW ARMS HEAD 
END . 



MODEL V 

Ml PARTS LI L2 

M2 LINE LI, LINE L2 

M3 CONNECTED LI L2 (VIA ENDPOINTS) 

END 



MODEL EQUITRI 

Ml PARTS (SIDE 3) (ROTATION 3) 

M-2 FOR-EACH SIDE ( = (LENGTH SIDE) 100) 

M3 FOR-EACH ROTATION (= (DEGREES ROTATION) 120) 

M4 RING CONNECTED SIDE 

END 



* (The predicate model language Is' an external 
representation which would be translated to an Internal for^t 
very slnilar to first order predicate calculus.) . 

1 

(Figure 2) 
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Intended Napoleon 
(Hand Drawn on the Tablet) 
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Sherlock would modify its representation for the NAPOLEON version of STICKMAN to reflect this 
additional information. 

Sheriock would now be ready to assist Debbie in defining a progr m to satisfy the 
NAPOLEON predicate model. We envision Sherlock as being capable of providing more than one 
overall style of assistance. One mode would be primarily backward-looking allowing the student to 
proceed without a great deal of help, but occasionally interrupting to ask the student for 
explanation or clarification of the reasoning involved in previous events. The requested 
explanations serve two functions: they cause the student to reflect on and become articulate about 
the problem solving process, and they provide guidance to internal modules of Sherlock (such as the 
student modeller) when the purpose of a type-in is ambiguous or obscure 

Initially in its backward-looking mode, iherlock remains silent, as Debbie types: 

right 90 
forward 50 
left 120 
forward 100 
left 120 
forward 100 
lfft 120 

forward 500 {Figure 4} 

Oh, no! Erase that last forward. 

Ok. "Forward 500" hae teen *nud. Do you with to define the other linet a$ a proredun? 

Ordinarily, in this backward-looking style, the tutor would intervene only upon request or 
when an error has occurred. It is probably at such points that the student will be most amenable to 
suggestions. In this case, the tutor's intervention immediately follows the occurrence of a typing 
bug The tutor's subsequent question serves to remind the student of the importance of u$lng 

subprocedures. 

A more forward-looking style of tutoring should also be possible, in which the tutor 
actively prrmpts the student Such a mode take: more of the initiative away from the student, 
however, and should be used with discretion litre, the tutor could have decided to intervene 
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sooner, provided that there was sufficient cause. On the basis of running its simulation model of 
Debb.e. the tutor m.ght have expected that she would not use s.ibprocedures. and hence would 
encounter too many bugs attempting the napoleon problem on her own Even so. with its innate 
b.as toward act.ve learn.ng. Sherlock would hesitate to interfere. However, for illustrative purpose*, 
assume that in this case the Sherlock tutor did enter its forward-looking mode. Hence, immediately 
following the sketch recognition sequence, but before Debbie began to type in code, the tutor might 
have asked 

Do you have a plan? 

Well, tort of. I thought I would start with hit hat and work downward. 

This response suggests that Debbie has mastered a particular kind of -sequential- plan n 
which the mam steps are'achieved in an order which simplifies interfacing. The ordering strategy 
,s based on observing the domain-dependent fact that BELOW is a transitive predicate. These 
inferences regarding Debbie's planning knowledge would be recorded In the student model. The 
new information would cause the tutor to shift Its emphasis to a different topic in this case, the 
modular design of the individual main steps. Once again, for expository purposes, the tutor Is 
shown taking a too-strong initiative. 

Are you going to u$e any whproceiuret? 

No. 

Wmmm. / notice that you already have a program to drau, a triangle. Perhap, you could 
ute that? 

The tutor would try to build upon previously solved problems, generating and 
extending them. One of the ways in which this "evolutionary" planning strategy can be manifested 
is by using existing programs as subprocedures in the new project. 

In order to highlight a crucial pedagog.cal issue, in this instance we have portrayed 
Sherlock providing questionable advice: TRIANGLE contains a bug In that It does not halt. The 
critical issue is whether this sort of tactic is sound, in that it increases the frequency with which the 
student encounters H#») "duo* bugs, le difficulties whose correction provides valuable 
teaming experience. 4 

tKfc 15 
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Ok. That can be hm hat Here it the definition. 

to napoleon 
triangle 
back 50 
left 120 
forward 100 
back 100 
left 30 
forward 100 
back 100 
right 30 
forward 100 
right 30 
forward 100 
back 100 
left 60 
forward 100 
end 

Debbie has now defined her program. Her next action is to run the program. 

\ 

\ 

^ napoleon {Figure 5} 

\ Here, the tutor would call upon an expert program understanding module called Mycroft 
[Goldstein\l974] to annotate the performance of Debbie's program, analyze the unspoken purposes 
of the individual lines of code and diagnose bugs. 5 Mycroft would notice several bugs in the 
resulting picture, with respect to the napoleon model. 

No\ that Debbie's code employs few subprocedures, and with its bugs is not easy to 
understand Th^s might be an Appropriate point for explanatory requests by the tutor. Debbie 
could be asked, for example, to explain the purposes of certain lines of her code, or to indicate 
which of several plausible interpretations she intended. The questions would serve as confirmation 
of the Mycroft analysis. Hence the questions would be at an appropriately high level - not tedious 
~ and might unobtrusively help Debbie to pinpoint some of her bugs. 
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22. Debugging 

Mycroft's analysis of the bugs in Debbie's program would indicate to Sherlock which 
debugging strategies might be appropriate. Usually, the tutor would not immediately criticize the 
student's program. However, the expectations established by Mycroft^s analysis would serve to guide 
its response to possible student questions. Suppose that Debb e partly diagnoses the cause of ore of 
the bugs on her own. 

1 1 hM a bug! It's just drawing the tame old triangle, over and over. How come? 
Well. let 9 * §ee. Would you like to look at your TR1ANGLF code? 

The tutor is shown here guiding the student's search for the underlying cause of the bug 
with an extremely leading question. (It suggests which subprocedure has the bug.) This would be 
reasonable in a situation in which the tutor does not believe that Debbie could localize the bug 
without help. But suppose Sherlock believed that Debbie could localize the bug herself. An 
alternative scenario might continue as follows: 

Well, led it*. How could we find $uch a bug? 

I give up. 

Well, what ii the firu thing yomr f+ocedure doe*? 

I don't know. 

What ii the fir it subprocedure called by napoleon? 

Returning to the main dialogue, one serious problem with NAPOLEON is that TRIANGLE is 
a non-halting subprocedure. Even though the tutor has supplied a strong hint, it has not 
guaranteed that TRIANGLE is the faulty routine, nor has it explained why the code fails to halt. It 
has attempted to encourage the student to employ the debugging technique of checking the 
suspicious code independently of the remainder of the program. 

Debugging a suspicious code segment "in private" is an important debugging strategy, 
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wh:«-h seeks to simplify the analysis by excerpting the questionable code and examining it (and 
perhaps executing it) in isolation. Although often helpful, this debugging technique can be 
insufficient if the bug is due to some unexpected interaction between the subprogram and the 
global run-time environment. Nevertheless, it is an effective initial step toward isolating the 
problem. Suppose Debbie accepts the suggestion. 



Ye«. Print out triangle. 

TO TRIANGLE 
FORWARD 100 
RIGHT 120 
TRIANGLE 
END 

Do you $ee 1A0 problem? 

Yes. I*!»*t there some way I can mike it ttop? 

Understanding this question (even after it had been parsed into a formal query language) 
would require considerable guidance from expectations about the application domain (I.e., turtle 
geometry), programming languages in general, and prior knowledge of the student. Here, the tutor 
encourages applying another evolutionary strategy. 

Yo$. Do you remember how we did it for SQUARE? Perh*p$ you could u* that o» a pmttorm 
to work from. 

Oh, right, ok. Redefine triangle to be: 

to triangle 

repeat 3 trlangleside 

end 
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to trianglesidc 
forward 100 
right 120 
end 

Now run napoleon again. 

Here it it. {Figure 6} 

Debbie's ability to make the analogy, and incorporate the appropriate modifications of 
the SQUARE pattern, is evidence that she understands the iterative programming construct. This 
should be noticed by the student modelling component of Sherlock. 

2.3 . Planning 

The tutor might continue to guide Debbie through debugging her NAPOLEON procedure 
as originally designed. But the purpose of Logo Is not merely to achieve working programs. 
Debbie's procedure was developed using a "sequential" plan. But It used "in-line code" to implement 
main steps which - according to well-established precepts of programming style - should have been 
implemented as calls to separate subprocedures. So in this case the tutor is depicted recommending 
that Debbie revise her original plan, to encourage modularity and facilitate debugging. 

It's null not right. 

/ know. It might be ratirr to debug if you u$ed iubproceduret more. What about having a 
$eparate procedure for each part: the hat t the neck, the arm$ t the body, and the leg$? 

I gur** it wouldn't hurt. 

/ think it would help ~ then you could debug each one eeparately. When they were all 
working, you could pat them all together, and there would probably be fewer problmme. 

Ok. Here is the new napoleon program: 
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{Figure 6} 
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to napoleon 

triangle this hat! 

neck 

aras 

body 
legs 
end 

Considerable progress! Still, It would be more modular if the hat, accomplished by the 
call to TRIANGLE, were implemented as a separate procedure called (say) "HAT." This is because 
the name ■HAT" describes what the procedure is to accomplish; whereas the name "TRIANGLE" 
describe: how the hat is to be accomplished, information that the calling procedure (i.e., NAPOLEON) 
need not know. The tutor would normally not intervene here, though, since the student has 
probably been interrupted too frequently already. For illustrative purposes, the tutor is shown as 
overly enthusiastic. 

That $eem$ a lot better. But perhaps you $hould make the hat a $eparate procedure lrom 
TRIANGLE. That way, if you want to change It to a different kind of hat. you won't me** 
up your triangle. 

No, I don t think Til want other kinds of hah And if 1 did, I could always change it later. 
Very well. 

Even in "maximal intervention mode" the tutor should eventually relent! When the 
student persists, it is wise to let the difficulty run its course. Further insistence by the tutor on its 
notion of what is proper (in this case, modularity) will seem arbitrary. If the advice is sound, the 
probability is that subsequent events will reinforce the tutor's suggestions. 

Shall we continue working\>n the other gubprocedureif 

\ 

\ 

\ 

yen: \ 

\ 

to neck 
back 50 
end 
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to arms 
left 120 
forward 100 
back 100 
right 30 
forward 100 
back 100 
left 60 
end 



to body 
forward 100 
end 

to legs 
left 120 
forward 100 
back 100 

right 30 

forward 100 

back 100 r 

left 60 

end 

SSrr .tS JS- - — is -H— . - 

matter -m* brought to the student', attention immediately. 

Do „u .« .in. * P~*~ "> * « * "<* 

Now tk.t yo« mention «, • «H> •» « * ,ime - 

p, r fc.p, you couM improw your by W 
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Ok. Call it PI Have both arrm and legs just be call* to PI. 

Fine. Ptrhapt you can think of a better name for m Pl m f Otherwiie, you might forget what it 
do*%. Doe j the thape it draw* tuggett any name$ to you? 

It looks like an upside down "V" Maybe I'll call it "VEE". Now run napoleon. 

Probably the tutor, as just portrayed, has gone too far. The story might have continued differently: 

c 

Why don't you write the program yourself? 



However, continuing as before, with a very cooperative student: NAPOLEON now draws {Figure 7j. 

The hat's in the wrong place. Edit triangle. 

This bug provides a more convincing demonstration of the previous point regarding 
modular design than the tutor's admonitions ever could. 

TRI ANCLE u alio called by TREE, which you were working on before. If you change 
TRIANGLE, it could affect TREE. Are you sure you want to do that? 

Note that TREE was also affected by the previouvedit to TRIANGLE, which converted it 
from a non -halting recursive procedure to an iterative procedure with an implicit stop rule. 
However, this change was entirely beneficial, fixing a known problem in a partially finished 
FOREST {Figure 8} Perhaps the tutor should be considered remits, in not having pointed out this 
beneficial side-effect of using subprocedures immediately. We supposed that Sherlock chose to 
defer mentioning it, to avoid disrupting Debbie's train of thought. The matter could still be 
brought up later, during a recapitulation of the session. 

All right. Change napoleon to call hat. Make hat call triangle for now. 

(NAPOLEON edited. HAT defined.) 
— A wi$e deciiionf 
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' Debbie has probably learned the lesson. But she. is about to make another very onimw* 
mistake: approaching a debugging situation without a coherent strategy. Unless she demonstrates 
an understanding of the underlying causes of e'ach error., her proposed edlts>re apt to be 
haphazard or even counterproductive. 

' ~- ' ' >. ' : / 



A- 



■a 

C 



Do you undlntani what U wrong frith UP 

Note*«ctly. It'i juit 'onf- t ^ ( 

Things could have been different If tutoring were completely switched off. For example. " 

• # ' * 

.. . , _ 

H/IT edited. 

\ 

Run Napoleoh. ... 

lu worse than eter! Ill new get it I ttnnk Pll quit fe* toiay, . n 

Continuing where we left off: 

.3 Dmi il rfro* a Irian* Je, fOt li *• wppow* lof 

Yet. / 

Well then, .n. proolem i. proonKy i« «n. »«»P or d-n-p /" '* «*• *•* * «* 

starting i* the wrong place, or Hopping in the wri, ng place? 

It finish* up in the wrong place. Betidei, it'i tilted. 

Then perhap. what you need » a „tup .t.p before calling it, or a cleanup ...p after calling 
it, rather than any change* to the hat ittelf? 

Curr«n,.,. .h« ha. is • ".UK .r»n.p»r«,<- .obprocdure tt »I«T' »<" '» «««' I ' « h « 
„*' ,u«. in which .. begin.. (Th.. ., .naiogou, .0 Wraptt" I. .*««..* ^ ™ 
prog,.n, q.*. is oT«n orrf.r.bl, ,0 on, in whi. h -be end*, «,« of e,ch ,ou.in. .s h.nd 
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tailored to correspond to the desired starting state of its successor. In the latter case, rearrangement 
of the order of accomplishing parts leads to a necessity to modify main steps, even though they 
have previously been shown to accomplish their specified goals. But when state transparent main 
steps are interspersed with interface steps In the calling procedure, such changes are more easily 
made. This is precisely the sort of knowledge which the tutor is expected to convey. 

Ok. I'll put in a cleanup step after the call to hat Let's tee, After hat, the turtle tt facing 
north. Alio, it's at a vertex of the triangle, but it thould be in the middle of the bottom. So 
these steps are the cleanup for after the call to hat: 

right 90 
forward 50 
right 90 

Now rtt facing down, ready to draw the neck. 

An important component, which would be constantly operating behind the scenes is the 
"purpose oriented editor" (cf V [Miller & Goldsteio 1976c]). Sujch an, ( editing facility would accept 
requests, such as t^ose shown here, in which the location of the edit is specified in terms of its 
meaning, for example, as a "cleanup 1 step" relative to some "main step" and not in terms of (the 
usual) line numbers. Such a very high level editor avoids the necessity of communicating with the 
computer in an excessively syntactic fashion. Learning editing should not Interfere with the 
primary task of learning to solve problemi effectively. 

Ok. Do you, realize that NECK Xtiefined a* 

TO NECK 
BACK 100 
END 

The purpose oriented editor would routinely check for undesirable side effects of edits. 
These usually result from forgotten assumptions about the specifications of interacting 
subprograms, and are one of the most frequent causes of bugs in large systems. (Similar issues are 
considered in [Rich 8c Shrobe 1975]). 

Whoopt! I guest that last cleanup should be, "left 90". 
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vork. Anoihor approach would to .o chan g o nock, in c.». to o 



Well, that would 
forward itutrad of a fcock. 

, hkc my way better. Anyway, I ha»e to go home now. Coodbye. 

SAVING WORK AS: DEBBIE/WORK/32. A PLEASANT DAY TO YOU! 
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3. Conclusions 

The scenario included much detail, but only a few basic motivations guided Sherlock's 
performance. These were: 

I to encourage good problem solving habits such as modularity, as was 
illustrated both by the construction of nr*in steps as subprocedures rather than in-line 
code segments, and by the use of state transparency to facilitate rearrangements; 

2. to allow dialogue to take placeaTjfr* problem solving level, rather than at 
the level of programming language syntax; 

3. to facilitate the use of "evolutionary" plans (plans that take advantage of 
previously solved problems and programs), as was the case with the use of a previously 
defined iterative SQUARE program to suggest the pattern for a halting triangle. 

4 to guide a process of successive experimentation and debugging, one of the 
important problem solving techniques that an individual must master. 

We began this essay with the claim {hat the design of AI based personal learning 
environments is a useful vehicle for pursu ng goals of AI, psychology, pedagogy and computer 
science The scenario portrays a tutoring program which employs diverse sorts of knowledge: 
knowledge about problem solving, programming and geometry, as well as knowledge about 
psychological modelling, discourse pragmatics and pedagogical strategy. In order to construct such 
computer programs, one must explicitly represent the problem solving methods and domain-specific 
knowledge to be taught, is well' as the pedagogical strategies to be employed. Moreover, the 
performance of such programs sei ves as one kind of test of the theories which they embody 

I. Developing a computational understanding of problem solving is a central 
AI concern Theories are precisely characterized as high level symbolic computer 
programs, in a fashion similar to the expression of physical theories in the language of 
mathematics. The extent of support for an AI theory is determined by the competence 
and efficiency of the associated computer program In performing its prescribed tasks. 
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2. Modelling the student's current knowledge, not only about the particular 
domain, but also about planning and debugging strategies, combines several crucial 
psychological issues A cognitive theory expressed as a computer program is supported to 
the extent to which it can simulate the student's responses, or predict likely difficulties. 

3. Procedurally representing tutorial strategies suggests an innovative 
theoretical framework for educational research. A pedagogical theory expressed as a 
tutoring program is supported to the extent to which it tends to elicit the desired problem 
solving behaviors, or responds appropriately to the student's questions. (Teaching 
methods isolated in the context of designing a computer tutor may also be appropriate 
for testing and use by human teachers.) 

4 Determining techniques for integrating the contributions of various 
knowledge sources echoes a recurrent computer science theme. The effectiveness and 
extensibility of alternative approaches provides evidence regarding the design 
methodology, data structures, and control structures used. 

The Sherlock tutor as a whole is only In a preliminary design stage. In other papers, we 
begin the technical exposition of the Individual areas of expertise that It must exhibit. In [Miller * 
Goldstein 1976a]. we provide an overview which clarifies the role of Sherlock in our overall research 
project In [Goldstein Sc Miller I976bl we formally develop our theory of planning and debugging. 
In [Miller Sc Goldstein 1976b], we apply this theory to protocol analysis for a student writing Logo 
programs In [Miller Sc Goldstein I976d], we consider the complex issues which must be resolved In 
order to automate the protocol analysis procedure. In [Miller Sc Goldstein 1976c] we describe a first 
step toward implementing such.a tutorial program: an Interactive editor for program writing that 
embodies our theory of planning and debugging 



ERIC 



31 



A! Based Learning Environments 



30 



Goldstein Gf Mitler 



4, Notes 

1. Although the authors prefer to think of Sherlock as a computer program which has yet to be 
implemented, one may also read the scenario from a perspective in which Sherlock is a human pedagogue 
etperimenting with a particular syllabus and style of presentation. Many of the same issues are raised. 

2. In order to illustrate the various capabilities which such a tutor should eihibit, particularly 
the knowledge of problem solving strategy which it should embody, the dialogue is presented with the 
hypothetical tutor in what would be its moil verbose flow, Thi$ would bo ro$orvo4 for demomtration 
purposes. Most students would normally be expected (and probably desire) to work more independently. 

3. The problem of recognising common two-dimensional sketches drawn on a tablet is an 
interesting and significant research area in its own right. However, a preliminary version of Sherlock, which 
constrained the student to select a project from a small fiied database of elementary drawings, could still be 
of value both thedretically and practically. The diversity of projects selected by beginners during the first 
few weeks of Logo experience is not great: polygons, spirals, trucks, houses, trees, stick figures. 
Considerable leverage might be obtained even by human Logo teachers if they restricted projects during the 
firat few weeks to fall within one of a few carefully analysed sequences. 

4. One of the v,riues of constructing computer based learning environments is that such 
questions may be resolved ciperimftitally by contrasting slightly different versions of a single system. 
Otherwise, such an issue might be debated indefinitely on informal, intuitive grounds. 

5. The process of comparing the performance of a program with a description of its 
specifications is known variously as "performance annotation" [Goldstein 1974], "mcta-cvalualion" [Hewitt & 
Smith 1975], or simply, "proof of correctness" (a special case) [Floyd 1971 J. The astute reader may question 
the possibility of a computer program analysing the behavior of another computer program, in view of the 
"halting problem" and similar negative results in the theory of computation. The apparent parados ia 
resolved by noting that although such a module cannot be constructed "in general," programs can be levtsed 
lo handle a wide range of useful special cases. For more details on Mycroft's approach to this problem 
consult the Goldstein reference. 
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6. Debbie has just rawed a common objection: If Sherlock it lo be so sophisticated that it can, 
in fact, perform "automatic programming* within iU limited domain, why should Debbie bother to learn 
programming* But to argue that, guen such • tooi, she should not (or would not want to) learn to do it 
herself, is to argue against competent pedagogy in general. The same argument can be proffered with 
respcci to learning arithmetic given the aid of an electronic calculator, or learning any skill, for thai 
matter, giten accrss to an '-ipert human teacher. 
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